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There has been interest in finding a general variational principle for non-equilibrium statistical mechanics. We 
give evidence that Maximum Caliber (Max Cal) is such a principle. Max Cal, a variant of Maximum Entropy, 
predicts dynamical distribution functions by maximizing a path entropy subject to dynamical constraints, 
such as average fluxes. We first show that Max Cal leads to standard near-equilibrium results - including the 
Green-Kubo relations, Onsager’s reciprocal relations of coupled flows, and Prigogine’s principle of minimum 
entropy production - in a way that is particularly simple. More importantly, because Max Cal does not 
require any notion of ‘local equilibrium’, or any notion of entropy dissipation, or even any restriction to 
material physics, it is more general than many traditional approaches. We develop some generalizations of 
the Onsager and Prigogine results that apply arbitrarily far from equilibrium. Max Cal is not limited to 
materials and fluids; it also applies, for example, to flows and trafficking on networks more broadly. 
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I. INTRODUCTION 

There has been interest in identifying a variational 
principle basis for non-equilibrium statistical mechanics 
(NESM). On the one hand, phenomenological dynamics 
is well established. It consists of: (a) phenomenologi¬ 
cal relationships, such as Ohm’s Law of electrical current 
flow. Pick’s Law of diffusion, Fourier’s Law of conduc¬ 
tion, the Newtonian Law of viscosity, combined with (b) 
conservation laws, such Kirchoff’s current relationship, 
or similar relationships for flows of mass or heat. The 
combinations of relationships of types (a) and (b) leads 
to well-known dynamical equations such as the Navier- 
Stokes and Burgers’ equations of hydrodynamics or the 
diffusion and Smoluchowski equations, as elucidated in 
standard textbookJS. 

However, the search for a microscopic statistical ba¬ 
sis for these relationships has been more challenging; see 
for exampl^. While there have been many powerful and 
important methods for particular calculations, including 
the Langevin equation. Master equation, Fokker-Planck 
and Smoluchowski equations and others, nevertheless so 
far, there has been no foundational basis for NESM that 
provides the same power that the Sec ond Law of ther¬ 
modynamics provides for equilibrigP^. Indeed, multiple 
context dependent variational principles have been pro¬ 
posed for NESM, such as Minimum Entropy ProductiorP, 
Maximum Entropy Productiorf^, and Minimum Energy 
DissipatiorP. Nevertheless, a general variational quantity 
remains illusive. 

A common basis in the above principles is to begin 
with the ‘state entropy’, S = — logpi where thep^’s 
are the populations of equilibrium states i = 1,2,3,.... 
Then, a ‘local equilibrium’ assumption is made that S, 
which is fundamentally only defined in the context of an 


extremum principle for predicting equilibrium, can also 
be a useful predictor near equilibrium. Then the entropy 
production is defined as tr = dS/dt to determines rates of 
approach to equilibrium or of dissipation in steady states. 
One major drawback of the above methods is that they 
usually do not provide a natural quantifier for closeness 
to equilibrium; there is no systematic way to improve 
the near equilibrium predictions in terms of an expansion 
parameter. Here, we describe an approach based on path 
entropies, not state entropies, that does not have these 
problems, is applicable even far from equilibrium, has 
expansion parameters, and happens to give very simple 
routes to deriving properties of NESM. 

A goal of NESM has been to find a variational quan¬ 
tity which can be maximized while imposing suitable 
dynamical constraints. Such an approach goes beyond 
phenomenological descriptions of only average forces and 
flows and explains fluctuating quantities and higher mo¬ 
ments of dynamical properties as well. In 1980, E.T. 
Jaynes proposed a candidate NESM variational principle 
called ‘Maximum Caliber’ (Max Cal)(^. We and others 
have explored its applicability as a general foundation 
for NESlvPiSl. Here, we demonstrate that major results 
of NESM can be derived from assuming that Max Cal 
is a general foundational principle, these results are the 
Green-Kubo relations, Onsager reciprocal relations, and 
a generalized Prigogine’s principle. 


II. THEORY: THE MAXIMUM CALIBER APPROACH 

For concreteness, we consider a discrete-time discrete- 
state system with two types of fluxes: of ‘stuff’ a and 
‘stuff’ b. Examples of a and b include heat, mass, elec¬ 
trical charge, momentum. We allow for the coupling be¬ 
tween the two fluxes; the flux of a may depend in any way 
on the flux of b. We assume that the system reaches a 
macroscopic nonequilibrium stationary state after a long 
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FIG. 1. An illustration of coupled heat and particle flows. 


time after it has been coupled to gradients across its 
boundaries that set up the fluxes. Figure illustrates 
with an example of coupled heat and particle flows in 
one dimension. 

Suppose the system has N discrete states {1, 2,..., iV}. 
Let us define an ensemble {F} of stationary-state micro¬ 
trajectories F =•••—>■ i —>■ j —)■... of fixed duration. 
The duration of the trajectories is not important, so we 
keep it unspecified. Based on how the system is coupled 
to the gradients and the internal structure of the system, 
each micro-trajectory F will correspond to a specific value 
of flux jar{t) of type a (and b) at any time t. The en¬ 
semble average of the flux Ja(t) of quantity a at time t 
is then given by 

Ja{t) = {jar{t)) = y^Prjar(0- (1) 

r 

where pr is the probability of trajectory F. It is clear 
that different probability distributions pr could lead to 
macroscopic fluxes Ja{t) and Jb{t). The strategy of Max 
Cal is to seek the particular probability distribution pr 
that maximizes the path entropy and is otherwise con¬ 
sistent with the ensemble averaged fluxes Ja{t) and Jb(t) 
for all times t. We maximize the path entropy or the 
Caliber, 


C = -^prlog— (2) 

P Qr 

subject to normalization and flux constraints. Here, qr is 
the reference probability distribution of trajectories when 
there are no gradients, i.e. at thermodynamic equilib¬ 
rium. From Fig. it is clear that there are multiple 
choices of qr, for example, it may correspond to the equi¬ 
librium distribution at Ti and pi or to the distribution 
at T 2 and fi 2 - As an aside, the conditions for equilib¬ 
rium (see below) are that (a) there are no net fluxes at 
equilibrium i.e. 


(jarit)) = '^jarit)qr = 0 (3) 

and similarly for {jbr{t)) and (b) the equilibrium state 
satisfies microscopic reversibility: the trajectory ensem¬ 
ble averages at equilibrium are unchanged under path 
reversal. Under the situation where the flux is odd under 
time-reversal the condition (b) yields (a). 


The Calibeil^ is maximized with the constraints on 
the macroscopic fluxes of a and b at time t for all t, which 
are enforced by the set of Lagrange multipliers {Aa(t)} 
and {Ab(t)}: 


- ^ Pr log — + ^ Aa (f) ( ^ Pr jar (i) - (0 


qr 


+ ( '^Prjbrit) - Jb{t) ) -f a [ ^pr - 1 I . 


( 4 ) 


Maximizing the Caliber with respect to the trajectory 
probability pr gives 


Pr = ^ exp [Xait)jar{t) + At,(<)j6r(f)]^ 


with the dynamical partition function Z 


( 5 ) 


^ = X! exp ( ^ [Aa(f)jar(f) + Xbit)jbr{t)] 


( 6 ) 


Equations ([^ and (|^ are the expressions of the prin¬ 
ciple of Maximum Caliber for two types of flows. Like 
Maximum Entropy for equilibrium statistical mechanics. 
Maximum Caliber for nonequilibrium computes macro¬ 
scopic quantities as derivatives of a partition-function- 
like quantity (in this case a sum of weights over the dif¬ 
ferent pathways). For example, average flux quantities 
are first derivatives of the logarithm of the dynamical 
partition function: 

Ja{t) = (Jar(t)) = E^^rjar(f) = 1^. (7) 

Identical equations follow for Jb(t). Eq. 0 allow the 
calculation of Xa{t) and Xb{t) from the knowledge of the 
functional form of Ja[Aa(t), A6(t)] and Jb[Xait), Xb{t)] as 
well as the constrained values. Higher moments of the 
dynamical distribution function can be calculated by tak¬ 
ing higher derivatives of log Z. For example, the second 
order cumulants are 


{jar{t)jar{T)) - {jar {t)) {jar {t)) 


{jar{t)jbr{T)} - {jar{t)){jbr{T)) 


9{jar{t)) 

dXair) 

dXa{t)dXa{T) 
d{jar{t)) ^ d{jbr{T)) 
dXbir) dXa{t) 

52 \ogZ 


dXa{t)dXb{T) 


( 9 ) 


Identical expressions follow for b. 

So far, this development is general, allowing for time- 
dependent fluxes. However, for our purpose below of 
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touching base with three well-known results of NESM, we 
now restrict consideration to stationary flows, (jar(f)) = 
Ja and {jbr{t)) = Jb for all times t. Appendix 1 shows 
that it follows that the corresponding Lagrange multipli¬ 
ers Aq, Xb are also independent of time. Now, we show 
how the Green-Kubo relations, Onsager’s reciprocal rela¬ 
tions, and Prigogine’s minimum entropy production theo¬ 
rem, are derived quite simply from Equations ([^ and 


L 


ab — 


d'^ log Z 

^ dXa{0)dXb{T) 


'^{jaiO)jb{T))x=o 

r 

'^{jaiT)jb{0))\=0 

T 

Lba. (13) 


A. Deriving the Green-Kubo Relations from Max Cal 


The Green-Kubo relations are well-known expressions 
that give the relationships between various transport co¬ 
efficients, on the one hand, and time correlation func¬ 
tions at equilibrium, on the other. Here, we show that 
they can be derived quite directly from Max Cal. Con¬ 
sider a coupled flow system in the linear regime and 
at stationary state when the driving forces are small. 
The macroscopic dynamics is time invariant (i.e. steady 
state). Concentrating on the fluxes at some time, call it 
t = 0. Now, expand around small driving forces A « 0. 
So, {jar{t)) = JaiO) at t = 0 is expanded to first order 
around Aa(T), Af,(r) = 0 for all r: 


uo )« E 


^(jar(O)) 

9Ao(r) 


Aa('r) 

A=0 


^(jar(O)) 

dXbir) 


>^b{T) 

A=0 


= E^'l“r(0)jor(T))A=o + Ab'E(jar(0)jfer('7~))A=o- 

r T 

( 10 ) 


In Eq. (10), we recognize that at A = 0, pr is equal to 
the equilibrium distribution qr and {jar{t)) = (jbr(t)) = 
0. When the system is in steady state any time depen¬ 
dence of the Lagrange multipliers Xa and Af, will vanish 
(see Appendixfor the proof). 

Eq. ( [Io| ) give the Green-Kubo relationJi^lti^ between 
the linear transport coefficient and the flux autocorrela¬ 
tions. So, up to a constant factor, the Lagrange multi¬ 
pliers can be seen as the driving forces. 


B. Deriving the Onsager Reciprocal Relationships from 
Max Cal 


When two types of flows are linearly proportional to 
the two corresponding forces (i.e., in nea-requilibrium sit¬ 
uations, then we have 

Ja — J-^aaXa T LabXb (H) 

Jb — J-^baXa T LbbXb- (1^) 


For this situation, Ons ager derived the reciprocal rela¬ 
tionship that Lab = LbJISEoi This result can be derived 
straightforwardly from Maximum Caliber. From Eq. (§, 
and (101 above, we have 


The last equality follows from microscopic reversibility of 
the equilibrium state. We have assumed that both fluxes 
have the same parity under time reversal. Summing (or 
integrating) over r will not affect the symmetry of the 
matrix L. 

It is clear that the symmetries in transport coefficients 
arise from microscopic reversibility of fluxes at equilib¬ 
rium. Are there other such symmetries amongst the 
higher-order transport coefficients for systems not near 
equilibrium? While there has been a considerable ef¬ 
fort to discover such symmetries, no clear general results 
have been obtainecplH^il Qur development shows that 
n**' order expansion of the flux in terms of the thermo¬ 
dynamic gradients will involve (n -I- 1)®* order cumulants 
functions among fluxes at equilibrium. These cumulants 
do have some symmetry properties owing to microscopic 
reversibility and translational invariance with respect to 
time. Nonetheless, in appendix [B] we show that there are 
no simple relationships between higher-order transport 
coefficients. 


C. Deriving Prigogine's Principle of Minimum Entropy 
Production from Max Cal 


Prigogine developed a variational principle for two cou¬ 
pled flows near equilibrium. If one of those flows a is 
driven by a given force, and if the other b is uncon¬ 
strained, then the flux of b is predicted to b e that which 
has the minimum rate of entropy productiorP^I^. First, 
here is the standard development. If the state entropy 
is S, then the rate of entropy production in a system 
carrying two fluxes Ja and Jb is given by 

dS 

c = -w = JaXa + JbXb (14) 

at 

where Xa and Ab are driving gradients. Using the Onsager 
relationships near equilibrium, we have 


O' — LaaXa + 2LabXaXb + LbbX^. (15) 


Prigogine’s principle then seeks the entropy production 
rate that is minimal with respect to variations in A^, 

d(7 

—— = 2{LabXa + LbbXb) = 2Jb — 0, (16) 

OAb 

which, correspondingly also predicts that Jb = cP. 
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Now, here instead is the same principle derived from 
Max Cal. First, express the Caliber as 


C = -EPrln(^ 


9r 


= InZ - ^ [Xait)Ja{t) + Xbit)Mt)] . (17) 


Now, maximizing the Caliber gives 

dC 


dXb{T) 


= -E 


+ v(t) 


5Ah(r) 


(18) 


~XaLab ~ XbLbb + 0{}?) — —Jb — 0 


in the linear regime this is exactly the same result as 
the Prigogine’s principle of minimum entropy production. 
Max Cal makes an easily falsifiable prediction beyond the 
linear regime. The Caliber is maximized when 


E 


Xa{t) 


dJqjt) 

dXbir) 


Xb{t) 


dJb{t) 

5Ab(r) 


= 0 . 


(19) 


If through detailed experiments, one knows how Jq and 
Jb depend on the imposed thermodynamic gradients Xq 
and Xb, one can find out the gradient A;, to which the 
system adjusts itself when it is not constrained by solving 

Eq. pi). 


III. CONCLUSIONS 

The principle of Max Cal is a putative variational prin¬ 
ciple for nonequilibrium statistical mechanics. We show 
here that Max Cal provides a natural and simple route 
to deriving several key results of NESM, including the 
Green-Kubo relations, Onsager Reciprocal relations and 
Prigogine’s minimum entropy production principle. It’s 
principal advantages over other derivations are that it is 
not limited to near equilibrium, or to ‘local equilibrium 
assumptions’, has a natural ‘order parameter’ for defining 
a distance from equilibrium, and has a sounder basis in 
principle than quantities like entropy production rates. 
In short, the power of the method is its focus on path 
entropies, not state entropies. We explore higher-order 
generalizations of Onsager relationships and Prigogine’s 
principle for situations not near equilibrium. 
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Appendix A: Time Independence of the Lagrange 
Multipliers 


Here, we show Xa(t) and Xbit) are time-independent 
if Ja and Jb are time independent. It follows from the 
time-independence of Ja, and Jb and equations Q 


9 log Z d log Z 
dXait) dXair) 
dlogZ _ dlogZ 
dXbit) 9Afe(r) 


(Al) 


which are partial differential equations (PDEs) for the 
partition function Z for any pair of times t and r. These 
can be simplified by use of the chain rule 


1 dZ 1 dZ 

ZdXa{t) ~ ZdXa{T) 

\ dZ I dZ 

Z dXb{t) ~ ZdXbir)' 


(A2) 


We apply the method of separation of variables to solve 
these PDEs. We assume that the solution to Z{t) can 
be expressed as a product of arbitrary functions of each 
independent variable, n* ft{Xait))-gt{Xb{t)), substituting 
this into the PDEs above gives. 


1 dft{Xa{t)) ^ 1 dfr{Xa{T)) 

ft{Xa(t)) dXait) friXair)) 9Aa(r) 

1 dgtjXbjt)) ^ 1 dgrjXbjT)) 

gtiXbit)) dXbit) griXbir)) 9Ab(r) 


the left and the right hand sides of these PDEs are func¬ 
tions of different independent variables so they must be 
constant (we use c and k as the arbitrary constants) and 
this is true for all times t and r. The solutions are 
MXa{t)) = aexp(cAa(t)) and gt{Xb{t)) = bexp{kXb{t)) 
for any time t, and a and b are arbitrary coefficients. 
Since these are linear PDEs the general solution is a sum 
of the assumed form rit /t(^a(0) ■ 9 t{Xbit)). The parti¬ 
tion function can now be expressed in terms of the general 
solution and equated to the form in equation (§ yielding 


TO* exp a y] Xa{t) + ki'^ Xb{t) = 

i \ t t / 

9r exp I Y [>^a{t)jarit) + At,(t)jf,r(i)] ) ■ 


(A4) 


Identifying the index i with P and mr = gr-, then there 
are two solutions to this, one is a trivial solution where 
jarit) and jbrit) are constant in time which is not physi¬ 
cally interesting and the other where Aa(t) and Xb{t) are 
time-independent. 


Appendix B: The Lack of Symmetry Relations between 
Higher-Order terms from Microscopic Reversibility 


that resemble Onsager’s reciprocal relations for near equi¬ 
librium. We start with the coefficients of the second order 
terms. For Ja this will be the following terms 


^ y^(jar(0)jar(i)jar(T))A=o 

t,T 

+ XaXbY^ijar{0)jar{t)jbr{T))\=O 

t,r 

+ Y y^(jar(0)jhr(t)jbr(T))A=o- (BI) 

t,T 


A similar expression follows for Jb by replacing jar(O) 
with jbr(O) in the expectation values above. It will be 
assumed for the rest of the section that the all fluxes 
are odd under time reversal (as would be the case if the 
transported quantities are even under time reversal, such 
as energy or mass) the general relations will be discussed 
in appendix]^ Since the coefficients in the expansion are 
sums over moments we can simplify the sums and obtain 
relations between the moments by applying microscopic 
reversibility. Taking one of the moments and ordering 
the times as 0 < t < r microscopic reversibility gives the 
following expression 


{jir{0)jmrit)jnr{T))\=o = -(jnr(O)jmr(T - t)j/r('r))A=o 

(B2) 

where l,m^n are either a or b. Using this relation from 
time reversal several important relations can be observed. 
Equation (B2) and time translation invariance can be 
utilized together for more relations between cumulants 
in the series expansion. Shifting the time back by r on 
the right hand side of equation (B2) 


{jir{0)jmrit)jnr{T)}\=o = —{jnr{—T)jmr{—t)jiriO))\=o 

(B3) 

additionally with the time ordering t < 0 < t gives the 
following result from microscopic reversibility 


{jirit)jmr{0)jnr{T))x=o = —{jnr{—T)jmr{0)jir{—t))\=o 

(B4) 

we s ee b y using the equations ( |B3[ ) and (B4) in equa¬ 
tion (BI) each term will cancel with another or vanish. 
So the second-order terms in A when both fluxes have 
odd parity vanish in the expansion around equilibrium. 
These arguments can be extended to higher-order-even 
terms so the fluxes will be odd functions of driving forces 
Aa and Xb- 

The coefficients of third-order terms in the Ja expan¬ 
sion are sums over the time indices of the fourth-order 
cumulants of fluxes 


(iar(O)jir(Ojmr(T )jnr(s))A=o 

- (jar(0)jir(0)A=o(jmr(T)j„r(s))A=o 

— (jar(0)jmr(T))A=o(jzr(t)jnr(s))A=O 

— {jar{^)jnT{s)) x=o{jlT{t)jmT{T)) X=0- (B5) 


Here, we explore the question of whether there are 
higher-order reciprocal relations distant from equilibrium 


Here too, replacing every instance of jar(O) with jar(O) 
gives the cumulants for the third order terms for Jb- The 
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last three terms when summed over time can be expressed 
as 

-'^Lai'^{jmr{t)jnriT))\=o (B6) 

P t,r 

where the summation over P is the set of cyclic permu¬ 
tations of the labels l,m,n. The hrst order coefficients 
make a reappearance at third-order, but this is the only 
nicety. The expressions for the third-order coefficients are 
quite cumbersome, there is no simple symmetry relations 
one can obtain for them. Though evaluating these coeffi¬ 
cients can be simplified by using relations obtained with, 
time translation invariance, and microscopic reversibility. 


Appendix C: Various Cases of Mixed Time-Reversal Parity 
of Fluxes, and Higher-Order Symmetry Relations 


again with the time ordering t < 0 < t gives the following 
more general result from microscopic reversibility 

{jir{t)jmr{0)jnr(,T))x=o = 

ipmin{jnr{ — T)jmriO)jiri — t))x=0. (C4) 

When Co = Cfe = 1 the three equations above combine 
to show that for each term like {jar{0)jar{t)jbr{T))\=o, 
which is a term in the moment expansion of the coeffi¬ 
cient for the AaAb term in the second order expansion of 
Ja, there is an equal term in the moment expansion of the 
A^ coefficient for flux Jb, {jbriO)jar{T-t)jariT))x=o with 
0 < t < r. In the expansion of Ja part of the Xa^b coeffi¬ 
cient are {jar{t)jar{0)jbr{T))x=o with t < 0 < r. These 
terms equal {jbr{-T)jar{0)jar{-t))x=o and belong to the 
same sum for the AaAf, coefficient. Similar expressions 
follow when we switch the labels of a and b. So we can 
write Ja and Jb to second order in A as 


This appendix is a continuation of previous micro¬ 
scopic reversibility arguments made in appendix be¬ 
cause so far only the case where the fluxes were negative 
under time-reversal were considered. To first order in the 
expansion of fluxes if a and b flows have opposite parity 
under time reversal we obtain by microscopic reversibility 
and time translation 


(jar(0)i&r(T))A=o = -0'br(0)jar(r))A=o 

=-0ar(0)j6r(-'r))A=o (Cl) 

summing over r gives the first order transport coefficients 
implying they all vanish Lab = Lba — 0, so there can 
be no off diagonal coupling coefficient between flows of 
opposite parity. 

Here we will start considering the second order terms 
for the cases when the parity of jar and jbr are both even 
and when they are opposite to each. Lets define Ca and 
eb as the time reversal parity o f jar and jbr, respectively. 
The general form of equation (B2) is written as 


{jir{0)jmr{t)jnr{T))x=o = 

eieme„(j„r(0)jmr(T - t)jir{T))x=o (C2) 

and the time translation of the right hand side gives 


Ja — LaaXaPLabXbP —X'^ + {Ka+V)XaXb+- - r -^A^ 

(C5a) 

Jb = LbaXaP LbbXb+^ - ^+{KbP M)XaXb-\- — 

(C5b) 

where Ka, Kb, Pa, Pb,y and M are partial summations 
which calculate the second order response coefficients, Sa 
and Sb give the second-order response if the other driv¬ 
ing force is zero. Despite being able to simplify the sum¬ 
mations with microscopic reversibility and time transla¬ 
tion there is still no relationship between the coefficients 
themselves. 

For the situation of differing parity we will take Ca = 
— 1 and Cb = 1 without loss of generality since switching 
the labels of a and b will give the results for e;, = — 1 
and Ca = 1. Moments which are odd in jar will can¬ 
cel with other moments of equal and opposite value 
in a manner similar to what was mentioned in ap¬ 
pendix]^ but (jar(0)jar(t)jbr(T))A=o = (jbr(O)jar(T- 
t)jar{T)}x=o {0 <t < t) and (jar(Ojar(0)jbr(T))A=o = 
(jbr(-'r)jar(0)jar(-i))A=o just as occurred above 

Ja = LaaXa + {Ka + V)XaXb (C6a) 


{jIT {Q)jmr{t)jnr {t))x=0 = 

eiemen{jnT{-T)jmr{-t)jir{0))\=O (C3) 


Jb — LbbXb (Pb + D)Aa -l- Sb^ (C6b) 
this is effectively a hybridized version of previous results. 





